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ABSTRACT 

Spacecraft autonomy will be an integral part of mission operations in the coming decade. While recent 
missions have made great strides in the ability to autonomously monitor and react to changing health and 
physical status of spacecraft, little progress has been made in responding quickly to science driven events. 
For observations of inherently variable targets and targets of opportunity, the ability to recognize early if 
an observation will meet the science goals of a program, and react accordingly, can have a major positive 
impact on the overall scientific returns of an observatory and on its operational costs. If the onboard 
software can reprioritize the schedule to focus on alternate targets, discard uninteresting observations 
prior to downloading, or download a subset of observations at a reduced resolution, the spacecraft’s 
overall efficiency will be dramatically increased. 

The science goal monitoring (SGM) system is a proof-of-concept effort to address the above challenge. 
The SGM will have an interface to help capture higher level science goals from the scientists and translate 
them into a flexible observing strategy that SGM can execute and monitor. We are developing an 
interactive distributed system that will use on-board processing and storage combined with event-driven 
interfaces with ground-based processing and operations, to enable fast re-prioritization of observing 
schedules, and to minimize time spent on non-optimized observations. 

1. Introduction 

Fifteen years ago, the standard paradigm for obtaining observations was for astronomers to travel to the 
telescope. Now, with queue scheduling, digital imaging, and the Internet, instead of astronomers 
traveling to obtain their data, data is electronically delivered to their desktop. In this new paradigm, 
scientists involved with the project no longer have “their eye at the telescope.” Some astronomers argue 
(Saha et al. 2000; Massey et al. 2000) that the astronomer at the telescope can make timely decisions and 
therefore achieve the best science. This implies that in a queue-scheduled/remote observing environment, 
we will be able to optimize the quality of our scientific returns if we can find ways to enable the science- 
driven dynamic response that is achieved by the “eye to the telescope” approach of traditional ground- 
based observing. With the number of space based observatories playing an important and growing role 
in astronomy, we need to find better ways to remotely achieve this same science-driven dynamic 
response. 

1.1. Current space-based observatory operations 

Recent missions have made great strides in the ability to autonomously monitor and react to changing 
health and physical status of spacecraft (Bernard et al, 1999), yet little progress has been made in 
responding quickly to science driven events. At present, after the observer submits his/her detailed 
proposal, they have no further involvement in the observation execution, receiving their data often months 
later. Observers are usually very limited in the ability to change their observing plan close to the time of 
execution because of the rigidity in the observing schedule. If the observer has to make changes to their 
observations after a program has been submitted, it often loses its place in the long-range schedule, 
leading to an even longer delay in obtaining observations. Hence, changes to an observing program are 
done only if critically necessary. For observations of relatively static targets, this is fine. However, for 


- 1 - 



observations of inherently variable targets, or targets of opportunity, the ability to recognize early if an 
observation will not meet the science goals of variability or minimum brightness, and react accordingly, 
can have a major positive impact on the overall scientific returns of an observatory and on its operational 
costs. For these types of observing campaigns, there is a need for flexible scheduling to capture quality 
data to achieve science goals. 

1.2. Factors influencing science driven operations 

There are several factors that are essential if we are to even consider the possibility of reacting to science 
driven events in space based observing. These include: (1) the ability to schedule observations flexibly, 
(2) the ability to capture science goals in a machine interpretable format to make event driven decisions, 
and (3) the ability of the observatory to adapt dynamically and autonomously to a changing schedule or 
set of observing priorities. 

Flexible scheduling implies different things for different people. In this paper, we use the term to mean 
the ability to change the observing strategy within a given scheduling parameter space. For example, one 
can change the target, exposure length, number of exposures, etc. For a long term variability study, it is 
desirable to be able to change the frequency with which a target is observed depending on the target’s 
outburst phase. When an observer is at the telescope, they can evaluate the existing conditions and/or 
initial observations and adjust their subsequent observing parameters to adapt to those conditions. In 
order for an automated flexible scheduling system to be successful, it must accommodate these scientific 
parameters: we must capture the science goals of the project and autonomously set the optimal parameters 
to achieve those goals. 

At present, science programs are specified by the mechanics of the observation. The underlying goals of 
the observation are not captured in machine interpretable format. For example, in an observing proposal 
only the target, instrument/detector/filter combination and the exposure time are captured. The 
underlying science goals of the observation are not captured even though they are often clearly stated in 
the scientific justification of the program. For example, an astronomer may want to observe a variable 
brightness target long enough to achieve a particular signal-to-noise ratio (SNR) instead of a fixed 
exposure time. Exposing for less time than necessary to reach the SNR will not achieve the science 
objective, and exposing longer than necessary is inefficient and could risk overflows that damage the 
observation. 

Nor do the science programs capture contingency plans - if an event occurs that will disrupt the science 
plan, there is no mechanism to alter the plan to adjust for the new event. The results are periods of lost 
observatory time, lost/useless data, and lost opportunities for interesting science. This is specially the case 
for intrinsically variable targets. About 30% of the variability campaigns do not capture the phenomenon 
effectively. This is either because the observations could not be scheduled properly or the intrinsic 
behavior of the target did not become interesting until near the end of the campaign when no more 
observational time was available to the project. 

The ability to capture science goals is not only important to obtaining observations, but can also be used 
at the time of data download. Many of the upcoming missions will not only have better “eyes,” they will 
generate vast volumes of data making ongoing communication and data downloading more 
difficult/expensive. Significant research and development efforts such as the Ultra High Data Rate 
Communications (Prescott and Bhasin, 2001) are underway to increase the download capacities to meet 
upcoming demand, but the bandwidth may not be achieved fast enough and it will come at a cost. The 
cost of downloading every pixel of these immense datasets may exceed the feasibility for cost-capped 
mid-sized missions that must share existing communications resources thereby restricting their available 
bandwidth and contact time. The download challenges will be further compounded by upcoming 
constellations of high data rate spacecraft, each needing to download data over an increasingly crowded 


- 2 - 



communications facility. Consequently, it will become increasingly important to be able to autonomously 
evaluate the data prior to downloading, and download only scientifically valuable data. If we have the 
ability to determine the status/quality of an observation before transmission to earth, we can use our 
scant data communications resources efficiently. This pedigree of an observation can be determined using 
the science goals for the proposal if the observer/scientist has the ability to define simple analysis 
algorithms for onboard execution. 

Observations do not always proceed as required by the scientist close to the time of the observation, and 
at present, the observer has little voice in how the observatory responds to these anomalies. The resulting 
observational data may be less than optimal, or even useless. If the observatory can reprioritize the 
schedule to focus on alternate targets, discard uninteresting observations prior to downloading, or 
download them at a reduced resolution its overall efficiency will be dramatically increased. By giving 
astronomers tools to evaluate their programs in entirely new ways, we envision not simply productivity 
gains, but the ability to optimize a program both to increase the level of scientific return, and to avoid 
observations where the quality of an observation does not live up to expectations. 

2. Enabling technologies 

While increasing data gathering capabilities is driving the need for goal driven observing, there are also 
emerging technologies that will enable its development and implementation. 

2.1. Onboard capabilities 

The onboard processing and storage capabilities of missions are increasing at a significant rate. The next 
generation of missions will have the necessary onboard processing and storage for performing 
sophisticated calculations in near real-time. The Next Generation Space Telescope (NGST), for example, 
is currently base-lining a flight CPU capable of sustained operation of at least 80 MIPS, with an option to 
increase to 750 MIPS before launch in 2010 (NGST SBC PRD, 2001). NGST data volume studies 
recommend approximately 50 GB of onboard storage for science data (Isaacs, 2001). With these 
capabilities, future missions will be able to conduct real-time science data analysis onboard. 

2.2. Enabling software technologies 

As onboard processing, memory, and storage capacities increase, so to do the power of the onboard 
software tools. There have been significant advancements in embedded systems with the emergence of 
such tools as Embedded Linux, and the Java 2 Micro-Edition (J2ME), both of which are designed to run 
on small, power and memory constrained devices with little or no direct user-interfaces. This will allow 
a jump in the flexibility of onboard software. Both Linux and Java have well-developed, multi-threaded 
capabilities that contain well respected security precautions built into their architectures. Such 
capabilities are readily available currently, and should be aboard spacecraft within the next few years. 
These technologies will substantially increase both the on-board software capabilities, but also ease the 
software development costs for developing applications as they are well-known development 
environments. 

2.3. Flexible onboard scheduling 

One desired outcome of detecting science events is the modification of the observing plan/schedule. The 
onboard planner and scheduler must be flexible enough to accommodate unexpected changes while 
maintaining a consistent plan and schedule. NASA’s Deep Space One spacecraft pioneered the use of 
onboard scheduling with the Remote Agent (RA) software. RA includes an onboard planner and 
scheduler that is able to re-plan based on changing spacecraft conditions (Chien et al, 1998). Another JPL 
product, CASPER (Continuous Activity Scheduling Planning Execution and Replanning) is an onboard 
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planner and scheduler that aims to achieve very high responsiveness to plan changes (Chien et al, 1999). 
CASPER uses iterative repair to support continuous modification and updating of the working plan as 
conditions change. CASPER is emerging as a popular choice for future spacecraft including Three 
Comer Sat (3CS) and Techsat 21. 

2.4. Event recognition algorithms 

The advent of increased processing power, onboard storage, and main memory in conjunction with 
sophisticated software environments have enabled the capability to detect observation events in a timely 
manner on a spacecraft. Previously, the amount of processing power to analyze the science data looking 
for significant features would have been prohibitive or impossible to attain. 

The Techsat-21 mission provides an example of an on board event detection algorithm. (Chien et al, 
2001) The spacecraft images a target volcano with its radar. Onboard it generates a reflectivity image. 
The Onboard Science Software compares the new image with the previous image to detect changes in the 
lava field. Based on the changes, the software interacts with the CASPER scheduler to arrange for a new 
high-resolution image centered on the area of interest. 

This technique of acquiring a new image or the creation of a new science product and comparing to 
previous acquisitions, looking for changes, is expected to be a common and effective onboard algorithm. 
Processing of this type has necessarily occurred on the ground in the past, but can now be migrated 
onboard to provide shorter response times for both the detection of changes and for the responses to those 
changes. 

3. Future technologies 

3.1. Dynamic algorithm definition 

Emerging standards such as MathML and the runtime protections of Java may allow a huge leap in the 
flexibility of online processing: the ability for a scientist to specify their own analytical algorithms to be 
run onboard as part of the goal analyzing. The scientist could then perform this analysis in near real-time 
as the observation is being made, instead of waiting until all the observations have been made, the data 
downloaded, cataloged, archived, and finally delivered to the scientist. Much work needs to be done to 
develop this concept: management and overseeing the amount of computation consumed, ensuring the 
protection of the spacecrafts software systems, pre-campaign validation of the algorithms, development of 
standard tools and data access interfaces within the scientist’s dynamic “runtime” environment, etc. 
However, this could yield a huge increase in the flexibility a scientist has and could enable a 
corresponding leap in the quality and efficiency of observing time. 

3.2. Natural Languages 

Ideally, science goals should eventually be captured at the highest level, i.e. in natural language. Making 
computers understand natural languages is ongoing research in the field of artificial intelligence. Efforts 
towards making machines understand human languages and/or act as them resulted in different 
generations of formal languages, with each generation trying to get closer to the level of natural 
languages. 

The challenges of natural languages aside, there are additional challenges for capturing goals: a specific 
terminology or word can have different meanings in different fields of science. This is driving research 
efforts to make World Wide Web a “Semantic Web”. One approach used in this arena may be applicable 
to SGM, is the use of “ontology.” Ontology defines the terms used to describe and represent an area of 
knowledge (E. Miller, 2002). They encode knowledge in a domain and also the knowledge that spans 
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domains. This effort tries to give meaning and common understanding of words to the users’ community. 
Having a standard and common understanding between the user and the way SGM interprets user’s input 
is critical to our goal capturing and definition efforts. 

Currently the problem of capturing science goals in natural language is vast, and the current state of 
information technology is not yet capable of capturing all conceivable science goals in machine 
interpretable format. But we believe there is a subset of science problems that we can and should be able 
to capture and reproduce. One example is to capture goals to represent an effective strategy for observing 
time variable phenomena. Therefore, in the Science Goal Monitor (SGM) project described below, we 
are confining our objectives to more feasible goals: developing a visual interface that can capture a subset 
of the “science goals”, i.e. goals that can be defined as measurable objectives; allowing a user to define 
contingency plans when appropriate; interfacing with the science data stream to determine if a goal is 
met; and then notifying the relevant person/scheduler regarding changes in priorities. 

4. Risk mitigation 

Introduction of flexible scheduling and autonomous reaction to science driven events will inherently 
increase automation in mission operations. It will also be a major change in the way missions are 
currently operating. Missions, especially complex high-profile missions, are more culturally and 
politically adverse to risk when it comes to automation. The trade-off between scientific gains for 
successful risks versus the damaging publicity for failed risks is difficult. In addition, on-board flight 
software has historically followed very conservative development and implementation methodologies due 
to the critical nature of the role it plays in the overall success of a mission. The skepticism is not limited 
to the flight software teams, scientists themselves remain leery of expert/automation systems and are not 
yet convinced that their unique goals can be effectively and accurately captured and executed. 

Clearly, the capture of science goals rather than the mechanics of an observation while developing 
observing programs, and the subsequent automatic analysis of the data stream to determine if goals are 
met, represents not just a leap forward in automation, but a wholesale change in the operations paradigm. 
We are in the early stages of the Science Goal Monitor project to develop prototypes, evaluate their 
effectiveness, and understand the risks. 

5. The Science Goal Monitor Project 

The Science Goal Monitor (SGM) project is a research effort funded by NASA Code R to determine if it 
is feasible to “get the eye back to the telescope” and to develop prototype software that will enable it. In 
the first phase of our study we have identified a subset of space science problems that are conducive to 
the philosophy of science driven observing. These problems are related to objects that are time variable 
and are often monitored for long periods. Using these problems as test cases for our prototype we are in 
the process of designing and developing the SGM system which is a set of tools that have the ability to 
capture the underlying science goals of an observation, translate them into a machine interpretable format, 
and then autonomously recognize and react in a timely fashion when goals are met. SGM will provide 
astronomers with visual tools to capture their scientific goals in terms of measurable objectives and be 
able to autonomously monitor the data stream in near-real time to see if these goals are being met. Our 
prototype is designed for use in a distributed environment where some analysis can be performed onboard 
a spacecraft, while other analyses can be performed on the ground. 

5.1. SGM Overview 

The Science Goal Monitor (SGM) system will interact with not only the data processing pipeline for a 
mission, but when used on board the spacecraft it will also interact with the raw data from the detector. 
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Figure 1 SGM System Overview (ground-based) 

Figure 1 shows the high-level concept of the SGM. SGM’s three key modules include: 


The Science Goal Capture Tool (SGCT) - an interface to be used by the astronomer to help identify and 
specify science goals in a manner that can be programmatically evaluated. 


The Science Goal Analyzer (SGA) - will interpret the science data stream from the detector/observatory 
and interact with its processing pipeline to analyze whether or not a set of science goals are being 
satisfied. 


The Science Goal Monitor Console (SGMC) - this will provide a visual interface and console for mission 
operations to query, monitor and interact with the SGA. 

Our initial proof-of-concept prototype will be a distributed ground-based solution, but our architecture 
will be designed to support a mixed space-based and ground-based system. An ideal operational scenario 
would include science goal monitoring systems both onboard and on the ground. Analysis could be 
moved between the two locations depending on the type of analysis and desired response time. For 
example, simple photon count analysis for a single image could be done onboard, while more complicated 
analysis that, perhaps, compares the data to existing archives would need to be done on the ground. 
Further, the system can provide support for the onboard monitor to communicate directly with the ground 
monitor, allowing the onboard and ground monitors to work in cooperation with each other. The onboard 
monitor may detect a possible event in a “quick” review of the data stream, and then communicate with 
the ground monitor where more extensive analyses can be initiated. 

5.2. Science Goal Capture Tool 

The primary purpose of the Science Goal Capture Tool (SGCT) is to capture the user’s science goals in an 
intuitive and easily understandable manner while simultaneously storing them in a format for easy 
machine processing. To achieve this mix of capabilities we are modeling the SGCT after “state diagrams” 
commonly used in computer science. State diagrams provide a simple visual way to represent complex 
behavior focusing on process flow rather than distracting volumes of words. 

Our users will express the goals of their observing campaign as a set of hierarchical diagrams which 
model the conditional flow of exposure sequencing within the user’s overall observation strategy. 
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Transitions from one state (or phase of the campaign) to the next are expressed as conditional statements, 
or goals which, when met, indicate the need to change the observing strategy. 

We are in the initial prototype stages of this interface and are working with scientists to assess and adjust 
the system to their intuitive reactions to the interface. We are working to remove the impression that the 
diagramming approach too complicated or “techy,” such as replacing the word “State” with the more 
user-friendly concept of a “Step” in the campaign. An example of an early design overview of the SGCT 
interface is shown below in Figure 2 SGM Science Goal Capture Tool. 

Within the SGCT, there are three main areas: 

The Step Diagram on the left-hand side is the area of primary focus. The user develops the step diagram 
here. The Step Diagram area is also used to enter additional information such as the statements to process 
within the step or expressions for the exit criteria from a step to some other step. 

The Context Area on the upper-right displays a simplified representation of the step diagram and it is 
used to indicate what portion of the overall diagram is being presented in the step diagram area. 
Individual steps may be comprised of sub-steps. These steps in turn may be subdivided into further sub- 
steps. The Context area not only shows the user where he is in the overall diagram, it also acts as a 
navigational aid. The user can double-click on a step and the step diagram will update to represent what 
is inside that step. 

In the lower right is the Templates and Variables Area. Scrolling lists of predefined items are presented 
here. The user can choose from a list and drag the item to the step diagram. This saves the user from 
having to completely define every item. Complex, predefined template steps can easily be inserted in to 
the user’s diagram. Additionally, the area will also show detailed information about step variables. For 
example, the variable’s name, current value and range of values as appropriate. 
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Once the diagram is complete, it is saved in an internal format, which can be processed by the Science 
Goal Analyzer (SGA). Of course, the diagram can be loaded, edited and resaved at any time. 

5.3. Science Goal Analyzer (SGA) 

The Science Goal Analyzer module will be the primary component that monitors the observing campaign 
underway and the state of the campaign goals defined by the user. As exposures are obtained the SGA 
will monitor their progress, see if the active goals of the campaign have been met, and make requests of 
the onboard scheduler for changes to the campaign as defined by the observer. The SGA will also react to 
messages and events coming from the onboard scheduler. We anticipate that SGA will work in 
cooperation with an onboard scheduler such as CASPER being developed at the Jet Propulsion Lab. SGA 
will be hierarchical, multi-threaded and have the ability to adjust its processing priorities to further 
evaluate interesting finds. In addition, an onboard SGA will work as a side process with the instrument 
and spacecraft flight software, as such it will not actually control the craft or the instruments, but rather 
will be able to make requests of the flight software or onboard scheduler (such as end this exposure, or 
change the time between exposures). The SGA will also monitor messages and data from the 
instrument/spacecraft flight software and update the status of its monitored campaigns accordingly. This 
partnership will allow SGM to introduce proactive flexibility while have the instrument and flight 
software continue to provide their traditional safety and control checks. 

5.4. Science Goal Monitor Console (SGMC) 

The operations console will provide an interface for an observatory’s operations team to view the status of 
the SGA and oversee the event handler. The monitor will initially act as both a testing module to observe 
and validate the workings of the SGA and as the initial implementation of an event monitor system. This 
also provides a means for direct human oversight, thus reducing the perceived mission risk associated 
with increased use of automation. 

5.5. Event Notification System 

An important component of the SGM will be the ability to send alerts to interested scientists and/or 
operations managers, alerting them when SGM has recognized an interesting event. There are several 
systems already in existence that can relay events and notify operators. One such tool is the Spacecraft 
Emergency Response System (SERS) developed at NASA Goddard Space Flight Center. For our initial 
prototype, we plan to simply route messages to the SGMC. In later stages, we plan to link to SERS and 
provide a graduated scale of information for the end-user from simple text messages, to partial image 
downloads and possibly other user-definable information. 

5. 6. Determine applicability of SGM to other domains 

While our initial focus has been astronomical observing campaigns of variable targets, SGM is applicable 
to a large pool of potential domains where there is a desire to dynamically change what to do next, based 
on some recognized feature of a current action. For imaging satellites: the ability to recognize that the 
upcoming suites of targets are cloud-covered and therefore not worthwhile, the ability to recognize the 
start of a flare and stay on that target instead of continuing to the next target. For constrained download 
environments: the ability to perform initial quality analysis on an image and if certain objectives are not 
met, then download only a highly compressed lower-resolution copy of the image and archive aboard the 
full image for retrieval only if specifically requested (or for discard after some period of time). Or, vice 
versa, if a satellite is not scheduled to perform a major data download for some period of time, then an 
onboard evaluation might trigger a high priority (and high cost) download and/or trigger priority 
messages to the operations center. 
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Similarly, initial onboard detection algorithm might trigger a priority request for search of archival data 
on ground, helping scientists recognize high-value data quicker than their routine data analysis techniques 
might achieve. 

6. Impact of the Science Goal Monitor 

The SGM project is a proof-of-concept to determine if we can effectively and efficiently obtain reliable 
and relevant data from scientists to make science driven scheduling changes. If successful, this will help 
maximize the science gained from the new generation of space-based telescopes/observatories and 
effectively manage scientific priorities. In SGM, there will be new rapid, flexible, and autonomous 
approaches to analyzing the quickly growing stream of data. The tools being developed in the SGM will 
help to improve the ability to monitor and react to the changing scientific status of observations. Such 
tools will be enablers for spacecraft autonomy. 

Currently, only the observation mechanics are carried into the mission execution. SGM will capture 
additional information in terms that the scientist will find useful ("Has the desired signal been achieved 
yet?", "Is the object bright enough to provide reasonable signal?", "Given an anomaly, can the science 
program be salvaged?"). SGM will also give the observer influence in how the observation is actually 
executed. It will capture the user’s plan for the observation execution, including instructions for what to 
do in case certain conditions occur. These contingency plans could be triggered when the SGM analyzer 
detects science events that match the observer’s criteria, or can be used in the scheduling of observations. 
The basic idea is to get the “eye back to the telescope”. 

SGM can also be used to automatically determine the status and quality of the data by comparing the 
observations with the desired scientific goals of the program. This is especially useful when data volumes 
are large and manual checks are not possible. SGM benefits any mission/observatory that has experienced 
scientifically failed observations, because such failures can be discovered faster. By automating some of 
these manual tasks, SGM can help contain science operations costs. 

7. Conclusions: Smart science and spacecraft autonomy 

NASA’s future plans include constellations, formations, federations, sensor webs etc. All of these will be 
economically infeasible without a substantial reduction in mission operations staff and costs. One of the 
proposed strategies to achieve these cost reductions will be to infuse automation technologies into the 
missions. But missions and scientists are more culturally and politically adverse to risk when it comes to 
automation. Unless we develop strategies that will help reduce the perceived risk associated with 
increased use of automation, we will not be able to contain costs. 

Furthermore, just automating the spacecraft’s technical operations will not intelligently handle the 
increasing volume of scientific data. We must begin automating both scientific data analysis and reactions 
to that analysis in a timely and still scientifically valid manner. In other words, we must teach our 
platforms to dynamically understand, recognize, and react to the scientists’ goals. SGM will help progress 
towards building intelligent spacecraft. 
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